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Abstract 

The Graduate and Professional Skills (GradProSkills) program is an initiative 
developed and run by Concordia University’s School of Graduate Studies and 
the university’s Office of the Vice-President, Research and Graduate Stud¬ 
ies. This paper presents a case study in which we describe the development, 
implementation, and evaluative components of the GradProSkills program. 
Drawing on data from a rigorously validated workshop evaluation tool and 
from attendance figures spanning a period of a little over two and a half years, 
we provide a picture of how Concordia’s graduate students are benefiting from 
the GradProSkills program. We present the results of both descriptive and 
inferential statistical analyses run on a pilot group of registrants who pro¬ 
vided evaluation data (n = 3,292). Our case study contributes an empirically 
derived model of extracurricular programming, with contextualizing details 
of administrative structures, curriculum-development initiatives, and part¬ 
nership efforts that have been used in operating the GradProSkills program. 

Resume 

Le programme « Graduate and Professional Skills » (GradProSkills) est une 
initiative creee et dirigee par l’Ecole des etudes superieures et le Vice-rectorat 
a la recherche et aux etudes superieures de l’Universite Concordia. Cet article 
presente une etude de cas dans laquelle nous decrivons la creation, la mise 
en oeuvre et 1 ’evaluation de GradProSkills. En nous fondant sur les donnees 
obtenues d’un outil devaluation d’ateliers rigoureux et valide, et sur des taux 
de participation s’echelonnant sur une periode d’un peu plus de deux ans 
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et demi, nous tragons le portrait de la fagon dont les etudiants aux cycles 
superieurs de l’Universite Concordia profitent du programme GradProSkills. 
Nous presentons des resultats d’analyses statistiques descriptives et 
deductives tires d’un groupe pilote de personnes inscrites a des ateliers qui 
ont fourni des donnees d’evaluation (n = 3 292). Notre etude de cas fournit 
un modele de programmation hors-programme derive empiriquement avec 
des details contextualises concernant les structures administratives, les 
initiatives d’elaboration de programmes et les partenariats dont le programme 
GradProSkills s’est servi. 


Context: Graduate Professional Development Programs 
at Canadian Universities 

With a competitive market and long-documented discrepancies between job offers and 
the skills of newly minted master’s and doctoral degree holders (Charbonneau, 2011; New- 
house, 1999; Tamburri, 2010), graduate students must develop professional skills, in addi¬ 
tion to their disciplinary knowledge, to be fully equipped for transitioning to employment 
markets within the academy and/or the corporate environment (Chillas, 2010; Ducheny, 
Alletzhauser, Crandell, & Schneider, 1997; Galt, 2012; Poock, 2001). In fact, the Canadian 
Association of Graduate Studies (CAGS) published in 2008 a report titled Professional 
Skills Development for Graduate Students, which emphasized that the obligations of high¬ 
er education institutions should include “providing graduate students with the best pos¬ 
sible preparation for their future roles whether within academic or in other sectors” (p. 4). 

A recent comprehensive survey of professional development programs (PDPs) avail¬ 
able across Canadian universities, by Marilyn Rose (2012), prepared for CAGS in associa¬ 
tion with the federally funded Social Sciences and Humanities Research Council of Cana¬ 
da (SSHRC), analyzed PDPs offered across Canadian universities and recommended best 
practices for their development in our nation. Results of Rose’s (2012) extensive review 
show that PDPs operate on a graduated scale of categories, with some universities hav¬ 
ing highly structured organization and high designated budget and personnel (category 
one), while on the other side of the scale are small universities that are witnessing some 
PDP activities but with no centralization and operating from small released operational 
budgets (category four). 

Elsewhere, Holaday, Weaver, and Nilson (2007) published an analysis of the elements 
that create a successful PDP; they assert that finding collaborative partners is one of the 
most important elements of securing a successful PDP. It has already been well estab¬ 
lished in prior research across well over two decades that successful PDPs possess institu¬ 
tional support, take into account participant evaluations, and offer training of relevance 
to their contingents (e.g., Birman, Desimore, Porter, & Garet, 2000; Guskey & Huber- 
man, 1995; Norton, 2001; Richardson, 2000; Wood & Thompson, 1993). 

Simon Fraser University’s (SFU) Report on Graduate Student Professional Develop¬ 
ment at SFU: Findings and Recommendations (2013) addresses the need to develop a 
program evaluation that measures learners’ satisfaction with PDPs and the skills gained 
as a result of participating in a PDP-related event, together with other evaluations target¬ 
ing organization, delivery mechanisms, and ability to meet intended learning objectives. 
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Such program evaluations can be achieved through post-attendance questionnaires, 
professional portfolios, informal interviews, as well as focus groups with attendees (Hola- 
day et al., 2007; Rose, 2012). Importantly, Rose (2012) exhorts universities to undertake 
studies to track the relation between success in gaining employment and students’ atten¬ 
dance of PDPs. 

Concordia University’s Graduate and Professional Skills Development 

Program (GradProSkills) 

GradProSkills is a PDP that responds to the market demand of graduate students be¬ 
ing well prepared by their respective universities before they exit to the workforce. Grad¬ 
ProSkills emphasizes giving graduate students better experience and more varied expo¬ 
sure to skills rather than focused proficiency in their respective specialized programs of 
study. The overarching aim of GradProSkills is to arm them with a whole array of profes¬ 
sional skills before they search for jobs in the labour market. 

The GradProSkills initiative consists of non-credit workshops and resources for gradu¬ 
ate students. It is designed to complement academic skills by training students in domain 
skills that they may not learn in their respective classrooms. GradProSkills has adopted 
the nine skill domains recognized by the CAGS (2008) report Professional Skills Devel¬ 
opment for Graduate Students as the most significant skills to be developed by graduate 
students seeking various career pathways, be those within academia, business/industry, 
health and biotechnology, arts and creative industries, government, or nongovernmental 
organizations. Post-workshop feedback forms were adopted as the formative course eval¬ 
uation tools to help improve student experiences (see http://graduatestudies.concordia. 
ca/gradproskills/ind_workshop_feedback.php). 

GradProSkills is closely linked to Concordia University’s Academic Plan (2012), for 
which experiential learning and community engagement are essential activities funda¬ 
mental to the university’s academic mission. These two elements help students transfer 
academic competencies into practical knowledge in society and increase their chances of 
success and motivation after they attain their academic degree. These components of the 
plan also help Concordia reach a goal of strengthening university-industry partnerships 
and tightening the connections between academics and the real world. GradProSkills 
responds to assertions made in the Academic Plan, wherein the university commits to 
creating funding opportunities for learners seeking to participate in applied learning via 
industry internships. 

In an effort to ensure efficient coordination among existing departments and faculties, 
GradProSkills offers a centralized administrative office via the School of Graduate Studies 
as it relates to professional development and career links, pooling resources that internal 
and external stakeholder institutions and placement providers can access. In addition, the 
GradProSkills webportal has a Build Your Toolkit option (see http://graduatestudies.con- 
cordia.ca/gradproskills/index.php?sid=3), whereby students can customize their course 
selections according to the career path they are seeking, connecting the latter to the related 
domain skills to be developed. Build Your Toolkit delineates a direct linkage between the 
courses and the nine essential domain skills recognized by the CAGS 2008 report. 

GradProSkills also reflects the increased focus on professional skill development rec¬ 
ommended by the Gouvernement du Quebec (2013). In their report titled Quebec’s Eco- 
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nomic Policy—Putting Jobs First: Investing in Jobs is Investing in Quebec, the govern¬ 
ment disseminated the province’s National Research and Innovation Policy for 2014 to 
2019. The Ministere de l’Enseignement superieur, de la Recherche, de la Science et de la 
Technologie, in conjunction with the Fonds de recherche du Quebec, will work with uni¬ 
versities to organize 1,200 additional internships in institutions for postsecondary stu¬ 
dents working in research and/or technology support and innovation. 

Part One: Development 

In the fall of 2010, Concordia University established a steering committee of senior 
academic administrators to oversee a three-year pilot project within the School of Gradu¬ 
ate Studies that would offer all graduate students and postdoctoral fellows free access to 
a comprehensive suite of graduate and professional skills training resources. To ensure 
GradProSkills program would respond to specific student needs, the working committee 
established in January 2011 included graduate student representatives from each of the 
four faculties (master’s from Fine Arts; doctoral from Engineering and Computer Sci¬ 
ence; doctoral from the John Molson School of Business; and doctoral from Arts and Sci¬ 
ence), one postdoctoral fellow from Arts and Science, and support staff from the School 
of Graduate Studies and the Office of Research. 

This student-driven approach has become a defining feature of the program, with the 
GradProSkills team employing up to 14 graduate students over the fall and winter semes¬ 
ters of an academic year as workshop assistants, language group leaders, web mainte¬ 
nance personnel, and program development team members. For example, presently, the 
GradProSkills program development team includes five graduate students. The events 
team member focuses on the planning and delivery of a variety of services, including 
career panels, alumni workshops, and network-building activities. The outreach team 
member promotes the program through orientation presentations and coordinates an 
ambassador program. Two graduate students make up the academic skills development 
team. The fifth and final online team member focuses on managing the social media con¬ 
tent for the program’s blog (called GradProBlog) as well as its Twitter, Facebook, and 
Linkedln profiles. 

The initial task of the working committee was two-fold. First, the committee cata¬ 
logued existing training resources available through various student services on campus. 
The exercise identified over one hundred potential workshops that were either already 
directed at graduate students or could be adapted to meet their needs. The second, re¬ 
lated, task reviewed existing graduate student PDPs across Canada to identify trends in 
the range and organization of resources. This review led the working committee to adopt 
the nine skill domains identified in the CAGS (2008) report: leadership; research man¬ 
agement; strategic communication; information and digital intelligence; career building; 
teaching and knowledge transfer; public spirit and social consciousness; wellness and life 
balance; and learning to learn. With funding from the Ministere de l’Education, du Loisir 
et du Sport (MELS), the steering committee also added a tenth skill domain area—second- 
language training in French—to facilitate students’ transition into the Quebec workforce. 

GradProSkills requires a centralized registration system to track and monitor partici¬ 
pation and to provide students with easy access to a record of participation. With the skill 
domains and registration system in place, the committee worked with web designers and 
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conducted focus groups with current graduate students, alumni, and faculty to develop 
a website that would allow students to browse workshop details and online resources 
by either skill domain, professional sector, or graduate training or through searches of 
the workshops calendar or individual partner pages. The final task of phase one was to 
negotiate partnership agreements with all service departments. GradProSkills offered 
each partner: (i) a dedicated partner page on the GradProSkills website (http://gradu- 
atestudies.concordia.ca/gradproskills/); (ii) the opportunity to maximize workshop par¬ 
ticipation through promotion on the website, in bi-weekly newsletters, and through social 
media; (iii) a workshop assistant to collect attendance and support the workshop leader; 
and (iv) feedback reports to review and revise content as required. Partnerships were fi¬ 
nalized by July 2011 and workshop/partner details added to the GradProSkills website for 
the program launch on August 4, 2011. 

Part Two: Implementation 

In its first year, GradProSkills and its partners delivered 196 workshops with 4,154 reg¬ 
istrations by 1,182 unique students across all faculties and streams (graduate certificate, 
graduate diploma, master’s, doctoral, and postdoctoral fellows), with almost 70% of the 
workshops filled to capacity. Using workshop attendants’ feedback and a second series of 
focus groups, the second year of the GradProSkills program focused on refining the exist¬ 
ing programming, developing graduate-level reading and writing strategies, and expand¬ 
ing career-building opportunities. An advisory committee of graduate program directors 
from each of the four faculties, a coordinator with the ESL program, and a learning spe¬ 
cialist from the University Writing Centre provided guidance to develop a graduate-level 
reading and writing program, including a three-day Graduate School Base Camp for new 
graduate students, held in the last week of August. Base Camp is a series of workshops 
designed for newly admitted graduate students to highlight the base-line or fundamental 
resources critical to a successful graduate school experience. These workshops are recom¬ 
mended for international students new to the Canadian university experience, graduate 
students returning to university after an extended absence, or current students looking 
for additional strategies to negotiate the graduate school academic workload. The second 
year also focused on the development of network-building events and outreach to external 
partners, including the International Association of Business Communicators - Montreal 
Chapter and the Young Chamber of Commerce Montreal. At networking events, the online 
team coordinated a video capture station and invited external mentors to share their best 
practices and professional journey stories. To date, over 40 videos have been captured and 
posted to the GradProSkills website. The workshop evaluation system was also refined 
in March of 2013 (see http://graduatestudies.concordia.ca/gradproskills/ind_workshop_ 
feedback.php). Additions to second-year programming expanded the workshops offered 
to 286, with registrations of 6,045 representing 1,866 unique students. 

The focus for the third year of GradProSkills was to expand the offerings through con¬ 
tinued refinements of the existing structure and to develop programs that would speak 
more directly to strategies for academic research career development and entrepreneurial 
opportunities. For each of the fall and winter academic terms, four faculty members with 
expertise in issues that students select via focus groups host discussions with graduate 
students on a particular research theme. The theme for the fall 2013 series was research- 
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creation; the theme for the winter 2014 series was managing multidisciplinary research 
projects. GradProSkills has also partnered with SAJE accompagnateur d’entrepreneurs, 
a Montreal-based non-profit organization that provides advisory services, coaching, and 
training to new entrepreneurs in Montreal. SAJE representatives have delivered work¬ 
shops, participated in networking events, and hosted a “Meet the Entrepreneur” event 
with four entrepreneurs who participated in their program. Concordia alumni have also 
been invited to propose workshops for sharing their postgraduate experiences with cur¬ 
rent graduate students. The graduate academic skills read/write/present program has also 
expanded to emphasize the importance of peer-review techniques to polish writing and 
presentation skills, as well as build important editorial skills necessary for graduate stu¬ 
dents interested in pursuing an academic career. These new program additions increased 
the fall 2013 offerings to 222 workshops with 3,402 registrations by 1,256 unique graduate 
students. At the start of 2014, GradProSkills was approved to transition from pilot to per¬ 
manent program. As a result, the administrative structure and funding of the program are 
currently being reorganized. 

Part Three: Results of Evaluation 

Instrument development. As part of the systematic development and evaluation 
of the GradProSkills program, we conducted classroom-based evaluations of the various 
offerings between March 2013 and December 2013 using the feedback form available at 
http://graduatestudies.concordia.ca/gradproskills/ind_workshop_feedback.php. The 
items developed for the evaluation instrument focused on individual graduate students’ 
perceptions of the effectiveness of the GradProSkills offering upon their completion of the 
program; it comprised a total of 12 statements, which students rated on a five-point Likert 
scale for their level of agreement. The items measured GradProSkills participants’ atti¬ 
tudes in three broad categories: course satisfaction, course quality, and instructor quality. 
The evaluation instrument was created in close consultation with experts in educational 
psychology, instructional design, as well as formative and summative evaluation methods. 

Sample and methodology. We received the voluntary participation of 3,292 reg¬ 
istrants out of a possible 5,403, yielding a 60.9% return rate. Table 1 shows the demo¬ 
graphic characteristics of the sample, which is representative of the larger population 
from which it is drawn in terms of the distribution of levels of study, stage of completion 
of program, and faculties to which participants belong. 

We used a combination of descriptive and inferential statistics to analyze the data 
from the evaluation instrument. To ensure the statistical validity of the analyses, we used 
the individual registrant as the unit of analysis, as opposed to each graduate student (note 
that each student might have registered in more than one workshop). In moving from in¬ 
dividual student to registrant as the unit of analysis, we employed intra-sample statistical 
analysis (ISSA) techniques (Shaffer & Serlin, 2004; Venkatesh & Shaikh, 2011). When one 
is confronted with data organized and analyzed by the learner as the unit of analysis, it is 
not uncommon to notice that the lack of a large sample, combined with repeated measure 
procedures, leaves very little room for powerful statistical results. Treating the registrant 
as the unit of analysis enables us to employ powerful statistical procedures with a rela¬ 
tively larger sample. For the purposes of our analyses, therefore, we were able to gener¬ 
alize only to all possible registrants between March 2013 and December 2013, which is, 
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by definition, limited to the graduate students who responded to the evaluation form. In 
addition, as per Shaffer and Serlin’s (2004) description of the notion of “exchangeability,” 
we treated each graduate student who responded to the evaluation form as a fixed effect 
in any statistical model so as to contextualize the results with respect to the sample of in¬ 
dividuals from which the registrations were drawn. Missing values were not replaced, to 
preserve the assumption of exchangeability required to conduct ISSA. 


Tablet 

Demographic Characteristics of Respondents to Evaluation (n = 3,292) 


Items 

Frequency 

Level of study 


Diploma 

253 

Master 

2,083 

Doctoral 

652 

Post-doctoral 

38 

Other 

266 

Stage of completion 


Beginning cycle 

995 

Mid-cycle 

598 

Near completion 

469 

Not specified 

1,230 

Faculty 


John Molson Business School 

245 

Arts and Science 

520 

Engineering 

1,443 

Fine Arts 

167 

Not specified 

917 


Composite creation. To create composites related to perceptions of course satisfac¬ 
tion, course quality, and instructor quality, which are employed in inferential statistical 
analyses, we report, in Table 2, means and standard deviations for all items included 
in the composites. We also report the inter-correlation ranges as well as the Cronbach’s 
alpha values, which are high enough to merit the creation of the composites. We were 
obliged to remove one of the evaluation items in the course quality composite, namely, 
“this workshop met its objectives” due to its high correlation (> .90) with each of the 
other three items in the composite, which inflates the inter-correlation ranges as well as 
Cronbach’s alpha, thereby diminishing the validity of the composite. Overall, graduate 
students partaking of the GradProSkills program were satisfied with the offerings they 
completed, as evidenced by the relatively large means values reported in Table 2. Apart 
from charting predictive relationships amongst the perceptual factors that impact course 
satisfaction, our analyses will also slice the data by demographic variables such as faculty, 
stage of program completion, level of study, and the skill domain covered in the Grad¬ 
ProSkills offering that the graduate student evaluated. 
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Table 2 

Descriptive Statistics, Intercorrelation Range, and Internal Consistency (Cronbach’s a) 
for Items in Composite Variables 


Composite items 1 

M 

SD 

Inter- Cronbach’s a 

correlation 

Range&p 
value 

Course satisfaction 



.728 to -794, -925 

p<. 001 

This workshop identified new skills important 
for my professional development. 

4.12 

1.009 


This workshop increased my knowledge about 
the topic. 

4.19 

1.003 


This workshop addressed my expectations of the 4.08 
training course. 

1.041 


This workshop provided knowledge and skills I 
will be able to apply to my studies/work. 

Course Quality 

4.14 

1.017 

.625 to .672, .846 

p<. 001 

This workshop had clear objectives. 

4-31 

0-959 


This workshop offered practical techniques/ 
strategies for applying new skills. 

4.14 

1.011 


This workshop provided appropriate resources 
to use and take away. 

Instructor Quality 

4.11 

1.019 

0.740 to .808, .925 

p<. 001 

The instructor of this workshop presented con¬ 
tent appropriately. 

4.28 

0.952 


The instructor of this workshop presented mate¬ 
rial in a clear and organized manner. 

4.28 

0-993 


The workshop had a presenter who responded 
to questions. 

4.42 

0.913 


The instructor of this workshop used methods 
of presentation that were appropriate to the 
topic. 

4.29 

0.950 



1 Response measured on a five-point scale from strongly disagree (1) to strongly agree (5) 

Perceptual factors predicting course satisfaction. We separately regressed the 
course satisfaction composite variable on the individual items from the other composites, 
as well as on the two composites of course quality and instructor quality. Overall, we were 
able to predict 81.4 % of the variance in course satisfaction with six items in the evaluation 
instrument (see Table 3). The only item that did not significantly regress into the equa¬ 
tion was the one that addressed whether the instructor “presented material in a clear and 
organized manner.” Further, the composites of course quality (p = .722) and instructor 
quality (p = .201) predicted 80.8% variance in course satisfaction (see Table 4). 
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Table 3 

Factors Predicting Composite Variable of Perceptions of Course Satisfaction 
Predicted Variable: Course Satisfaction (Composite) 


Items 1 

B 

SEB 

P 

The instructor of this workshop presented content appro- 

.048 

.016 

.050** 

priately. 

The instructor of this workshop presented material in a 

.025 

.015 

.028 

clear and organized manner. 

The workshop had a presenter who responded to ques- 

•055 

.015 

.055*** 

tions. 




The instructor of this workshop used methods of presen- 




tation that were appropriate to the topic. 

.110 

.014 

.115*** 

This workshop had clear objectives. 

•154 

.013 

.162*** 

This workshop provided appropriate resources to use and 

.271 

.012 

.303*** 

take away. 

This workshop offered practical techniques/strategies for 

•300 

.012 

333 *** 

applying new skills. 




R 2 

.815 



F 

1665.367*** 



Adjusted R 2 

.814 



*p<. 05, **p<.oi, ***p<.001 




1 Response measured on a five-point scale from strongly disagree (1) to strongly agree (5) 


Table 4 




Factors Predicting Composite Variable of Students’ Course Satisfaction 


Predicted Variable: Course Satisfaction (Composite) 




Factors (composite items) 

B 

SEB 

P 

Course quality 

■752 

.017 


Instructor quality 

.213 

.017 

.201*** 

R 2 

.809 



F 

5601.633*** 



Adjusted R 2 

.808 




*p<. 05, **p< .01, ***p<.ooi 


Differences in course satisfaction by level of study, faculty, stage of com¬ 
pletion, and skill domain. We investigated the differences in perceptions about 
course satisfaction across multiple independent variables using both one-way and facto¬ 
rial ANOVAs; note that n dips to 2,779 for all these results, due to missing values, and 
that all the results of post-hoc analyses are reported at ap value of 0.05 or less, along with 
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details of the statistically significant omnibus F tests. In using level of study as an inde¬ 
pendent variable, we found that doctoral students (M = 3.97, SD = 0.99, n = 554) were 
significantly less satisfied with their courses than postdoctoral (M = 4.19, SD = 0.74, n = 
28), master’s (M = 4.17, SD = 0.89, n = 1,751), and diploma students ( M = 4.19, SD = 0.99, 
n = 554), omnibus F{4, 2774) = 4.78, p < .001, Effect Size (ES) = .01. In using faculty as an 
independent variable, we found that students from the John Molson School of Business 
(M = 4.33, SD = 0.85, n = 225) were significantly more satisfied with their courses than 
those from the faculties of arts and science (M = 4.04, SD = 0.97, n = 436), engineering 
and computer science (M = 4.11, SD = 0.91, n = 1,228), and fine arts (M = 4.07, SD = 0.99, 
n = 144), omnibus F{4, 2774) = 4.17, p = .002, ES = .01. The independent variable of stage 
of completion did not yield a significant omnibus F when used in a one-way ANOVA with 
the course satisfaction composite as a dependent variable. 

To investigate whether and how the course satisfaction composite variable differed 
across the 10 different skill domains used to classify GradProSkills offerings and how it 
interacted with the other independent variables, we conducted a factorial ANOVA using 
the course satisfaction composite as a dependent variable, as well as level of study, skill 
domain, and faculty as independent variables. The only significant main effect found was 
for skill domain, F( 9, 2730) = 2.89, p = .002, ES = .01. Neither the main effects for faculty 
or level of study, nor the various interactions between faculty, skill domain, and level were 
statistically significant. Follow-up univariate analyses revealed that course satisfaction 
scores for GradProSkills offerings for the teaching and knowledge transfer skill domain 
were significantly lower (p < .05) than for all the other skill domains except the wellness 
and life balance skill domain (see Table 5 for descriptive statistics of course satisfaction 
by skill domain). 


Discussion 

Our results demonstrate that the development, implementation, and testing of a theo¬ 
retically grounded evaluation instrument is a necessary step in the systematic evalua¬ 
tion and upgrading of professional development offerings via a centralized administrative 
framework such as the one we offer at Concordia University. The rigorous application of 
needs analysis with stakeholders in the creation of the evaluation instrument was vali¬ 
dated by strong internal consistency between items that formed the composite variables 
of course satisfaction, course quality, and instructor quality. Our analyses revealed that 
course satisfaction was predicted most by variables that fell under the aegis of course 
quality rather than instructor quality; this might reflect the emphasis that registrants 
placed on the individual elements of the course, such as its objectives, the kinds of tech¬ 
niques it offered, and the resources that it allowed registrants to access, over the indi¬ 
vidual qualities of the instructor. These results could also be an artifact of the amount of 
time registrants were in contact with the instructor; many of the GradProSkills offerings 
last between 90 minutes and three hours, but only a few of the offerings involved repeated 
contact between workshop leaders and graduate students, which might have made it more 
difficult to create a perceptual relationship between the quality of the instructor and the 
students’ satisfaction. Our data analyses reveal that course satisfaction was significantly 
higher for students in the John Molson School of Business than for those in other facul¬ 
ties and significantly lower for doctoral students than for those in other levels of study. 
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However, these differences were rendered opaque when considered in a factorial analysis 
with the skill domains under which the course offerings were categorized. The analyses 
show that the teaching and knowledge transfer skill domain and the wellness and life bal¬ 
ance skill domain elicited lower levels of course satisfaction than the other skill domains, 
regardless of the student’s faculty and study level. Offerings that fall under the teaching 
and knowledge transfer skill domain are designed to help graduate students develop ped¬ 
agogical and administrative skills in preparation for being teaching assistants or teaching 
university courses; hence, it can be difficult to achieve the goals of such workshops, and 
the participants’ motivational outlook differs qualitatively from that of participants in 
other workshops. To explore these differences, future qualitative evaluations should take 
into account the different instructional approaches employed by workshop leaders, the 
content being covered in workshops, as well as the duration of the workshops. 

Table 5 

Course Satisfaction by Workshops’ Skill Domains (N = 2,779) 


Workshops’ skill domain Course satisfaction 



M 1 

SD 

N 

Career building 

4.21 

0.84 

653 

Digital intelligence 

4.40 

0.78 

186 

Leadership 

4-31 

0.82 

154 

Learning to learn 

4.09 

0.97 

424 

Language training 

4.10 

0.90 

271 

Public spirit 

4-44 

0.48 

23 

Research management 

4.10 

0-93 

310 

Strategic communication 

4.09 

0.94 

357 

Teaching and knowledge transfer 

3-85 

0.99 

328 

Awareness and life balance 

4.04 

1.03 

73 


1 Response measured on a five-point scale from strongly disagree (1) to strongly agree (5) 


Conclusion 

Following from the initial evaluation of perceptions of effectiveness of the GradProSkills 
offering, we believe that we need to draw upon several other triangulated sources of data, 
including feedback from workshop instructors and seminar leaders, focus groups with 
participants, and longitudinal achievement and attitudinal data from participants in any 
future evaluations of the program. In addition, it would also be desirable to prepare and 
apply to the GradProSkills program a quality-assurance model that reflects the contextual 
reality of Concordia University. One of the first steps that we plan to take is to integrate 
the administrative components of the GradProSkills program into the broader unit of Aca¬ 
demic Programs and Development at the School of Graduate Studies. The first project that 
would result from this integration would be to ensure the efficient and effective alignment 
of curricular and extracurricular outcomes from the variety of graduate programs offered 
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at Concordia University with those of the GradProSkills offerings. One of the major out¬ 
comes of the integration of GradProSkills into the Academic Programs and Development 
unit at the School of Graduate Studies will be knowledge exchange, which means that we 
will work with graduate students, graduate program directors, professors, researchers, ad¬ 
ministrators, and industry practitioners to develop ways to mobilize and update the in¬ 
sights generated by our GradProSkills team. Key foci include: (i) creating frameworks for 
evaluating graduate professional development across disciplines; (ii) providing training 
in evidence-based techno-pedagogical and instructional practices for graduate students 
seeking academic jobs; and (iii) developing policies on how best to track the employment 
history of Concordia alumni so as to create professional development opportunities that 
respond to the workforce-related needs of local and international industries. 

We are well aware of the two solitudes of the scientist and the practitioner or policy 
maker. There is too little engagement between researchers and practitioners in the field 
of graduate education, and this must be changed if the quality of professional develop¬ 
ment training is to improve. The question is how to do so, and the persistent and vexing 
nature of this challenge highlights the importance of creating a sustainable version of 
GradProSkills anchored in the scholarship of learning efficacy—one that will help illu¬ 
minate the obstacles and affordances surrounding knowledge exchange in the domain of 
graduate-level professional development. 

Our commitment is to work proactively with the community within and without Con¬ 
cordia and to select partners to integrate evidence-based tools and techniques into Grad¬ 
ProSkills offerings. Further, we will focus on implementation fidelity, along with wide- 
scale, long-term use of our empirically grounded curricular framework, thereby having a 
meaningful impact on curricular and co-curricular development, higher-order learning, 
critical thinking, and professional skill development in graduate programs. Also, by shar¬ 
ing expertise with educational administrators and policy makers, we hope to increase un¬ 
derstanding of the uses of evidence-based practices and the optimal conditions for imple¬ 
menting professional development models in graduate education.^ 
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